• 



PATENT APPLICATION 
Attorney Docket No.: D/98718 



APPLICATION FOR 
UNITED STATES LETTERS PATENT 



TO ALL WHOM IT MAY CONCERN: 

Be it known that we, Yeqing Zhang, a citizen of China, Robert P. Loce and 
Martin E. Banton, both citizens of the United States of America have invented a 



EXPRESS MAIL LABEL NUMBER: EL168131497US 
Date of Deposit: December 21, 1998 

CERTIFICATE OF EXPRESS MAILING 
I hereby certify that the following paper or fee is being deposited with the US Postal Service "Express 
Mail Post Office to Addressee" service under 37 C.F.R. 1 . 10 on the date indicated above and is addressed 
to : Assistant Commissioner for Patents, Washington, D.C 2023 1 



EDGE COMPACTION IN ANTIALIASED IMAGES 



nam 7£th^ 



December 21, 1998 



Elaine Zahn 



Patent Application 
Attorney Docket No. D/98718 



EDGE COMPACTION IN ANTIALIASED IMAGES 

v CROSS REFERENCE 

Cross reference is^nade to co-pending United States Patent Application Serial No. 
09/xxx,xxx, (Attorney docket No. D/98579) entitled "System For Electronic 
Compensation of Beam Scan Trajectory Distortion" by Loce et al. 

BACKGROUND OF THE INVENTION 

This invention generally relates to printing antialiased images and other image 
structures having gray edges and, more particularly, to an edge restoration method that 
compacts gray pixels into neighboring edges. 

Antialiasing in the context of digitizing line art and certain graphical image 
structures is well known as a method of using intermediate levels of intensity to achieve 
subpixel positioning to estimate the edges of lines and text. A major benefit of antialiased 
images is that high contrast, saturated objects are surrounded with pixels possessing 
intermediate gray values that visually suggest a higher resolution of object edges. 

Generally, antialiased images contain gray edges that are a single pixel wide. Gray 
edges that are a single pixel wide can be well rendered using anti-aliasing rendering (AAR) 
techniques. However, some image processing functions can introduce gray pixels to an 
antialiased edge thereby broadening the edge to two or more pixels in width. For 
example, electronic image registration correction is an image processing technology used 
to compensate for misregistration of images written onto a photoreceptor. The 
misregistration could be due to a variety of sources, such as bow differences between 
raster output scanners in a multiple output scanner imaging system. Electronic 
registration correction often uses interpolation of pixel values to compensate for pixel 
positioning errors. The interpolation can have the effect of slightly blurring an edge, 
thereby increasing its gray content. If an input edge is antialiased, then the interpolated 
image may have gray edges that are two pixels wide. Additionally, scanning processes can 




blur an edge such that the edge contains two gray pixels. Similarly, some super-resolution 
processing techniques can blur an edge to two gray pixels in width. 

Current antialias rendering techniques do not recognize gray edges that are two or 
more pixels wide, and thus the blurred edges will be halftoned. Halftoning antialiased 
5 edges that are two pixels wide can yield an undesirable beaded structure. Thus, what is 
needed is a method to compact a gray edge that is two pixels wide to a state where it is 
one pixel wide so that it may be well rendered with AAR. 

SUMMARY OF THE INVENTION 

10 In accordance with the present invention, there is provided a method for 

compacting diffuse gray edges. The method identifies a group of interested pixels with an 
observation window within continuous tone image data. The method then operates on the 
pixels within the observation window by: compacting horizontal features within the 
observation window; compacting vertical features within the observation window; and 

15 compacting corner features within the observation window. 

In accordance with a second aspect of the invention there is provided, in a printing 
system having a digital front end for processing image data to generate print ready data, a 
method for compacting a diffuse gray edge. The method includes the steps of: receiving 
image data; identifying a target pixel within said received image data; analyzing pixels 

20 neighboring the target pixel to determine if the target pixel is within a diffuse gray edge; 
and compacting gray pixels within the diffuse gray edge. 

BRIEF DESCRIPTION OF THE DRAWINGS 
A more complete understanding of the invention and many of the attendant 
25 advantages thereto will be readily appreciated as the same becomes better understood by 
reference to the following detailed description when considered in conjunction with the 
accompanying drawings wherein like reference numerals and symbols designate identical 
or corresponding parts throughout the several views and wherein: 

FIG. 1 is a general representation of a suitable system-level embodiment for one or 
30 more aspects of the present invention; 
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FIG. 2 illustrates the data flow through an image print path accordance with the 
present invention; 

FIG. 3 is a generalized data flow representation of one embodiment of the present 
invention; 

5 FIG. 4 is an exemplary 5x5 observation window employed by an embodiment of 

the present invention; 

FIGS. 5 - 12 illustrate various pixel patterns that trigger compaction; and 

FIG. 13 schematically illustrates an embodiment of the edge compaction method in 

accordance with the present invention. 

10 

DETAILED DESCRIPTION OF THE INVENTION 
For a general understanding of the present invention, reference is made to the 
drawings. The present invention is described herein as processing gray-scale continuous 
tone (contone) image data. However, it should be understood that the present invention 
15 applies equally well to the processing of color images, wherein each color image 
separation is treated, effectively, as a gray-scale image. Accordingly, references herein to 
the processing of gray-scale images are intended to include the processing of color image 
separations as well. 

Referring to FIG. 1, there is shown an embodiment of a digital imaging system 5 
20 that incorporates the features of the present invention. Digital imaging system 5 includes 
image source 10 that may include a scanner, a computer, a network or any similar or 
equivalent image input terminal to generate image data 12. Image data 12, representing an 
image to be printed, is supplied to an image processor 14 that may incorporate what is 
known in the art as a digital front end (DFE). Image processor 14 processes the received 
25 image data 12 to produce print ready binary data 16 that is supplied to a print engine 18. 
Print engine 18 is preferably a xerographic engine; however, engine 18 may include such 
equivalent alternatives as ink jet, etc. The present invention is directed towards aspects of 
image processor 14 depicted in FIG. 1. In particular, the intention of the present invention 
is to identify and process accordingly gray pixels within a diffuse or blurred gray edge. 
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Referring now to FIG. 2, there is shown a detailed diagram depicting the data flow 
in an embodiment of the present invention. In FIG. 2, image processor 14 receives 
unprocessed image data and performs image analysis and/or processing functions (not 
shown), which may include page decomposition, background detection, segmentation, 
5 color adjustment, electronic registration correction, etc., on the received image to 
generate contone image data 20 that is supplied to edge restoration block 22. Edge 
restoration block 22 operates on the contone image data to identify and process 
accordingly gray pixels within a diffuse gray edge. In particular block 22 analyzes a target 
pixel and a group of pixels neighboring or surrounding the target pixel to determine 
10 whether the target pixel is within a diffuse gray edge. A diffuse gray edge is presumed to 
be present when at least two gray pixels are present between a transition from a nearly 
saturated (black) pixel to a background (white) pixel. An affirmative determination will 
ji result in a subsequent compaction operation wherein the gray from one or more gray 

^ pixels more distant to the saturated pixel is shifted (donated) to the gray pixel adjoining 

y 15 the saturated pixel. Beneficially, edge restoration block 22 compacts a diffuse gray edge 
]j that is two pixels wide to a gray edge that is one pixel wide. The operation of edge 

* 1 restoration block 22 is described in further detail below with reference to FIGS. 3 - 13. 

f s After converting gray edges that are two pixels wide into edges that are one pixel 

■is 

If wide, the edge restored contone image 24 from edge restoration block 22 can be 

n 20 processed in a conventional manner. For example, contone image 24 may be processed 
^ (rendered) to transform the image into output data for subsequent printing or display. 

That is, the edge restored contone image 24 is coupled to anti-alias tagging (AAT) module 
26 and tone reproduction curve (TRC) module 28. AAT module 26 conducts an analysis 
of the neighborhood of the gray pixels to determine if the gray pixel represents a true gray 
25 value or an antialiased edge. AAT module 26 tags those pixels within image 24 
determined to be antialiased and outputs the antialiased tag to TRC module 28. 

At TRC module 28, the tags generated by AAT module 26 are employed in 
conjunction with the associated pixel values to modify the pixel values in a known manner. 
Subsequently, the modified pixels and their associated tags are passed to a pair of 
30 processing modules - halftoning module 30 and anti-aliased rendering (AAR) module 32. 





Although depicted as parallel functions, the processing carried out therein may be 
accomplished using a single processing block operating serially. The tags are supplied to 
both modules to control processing therein, and are also used as a select signal in 
multiplexer 34. Multiplexer 34 selectively passes print ready data from halftoning module 

5 30 or AAR module 32 to a ROS in response to the tags received from TRC module 28. 

Referring to FIG. 3, there is shown a diagram illustrating the data flow through an 
embodiment of edge restoration block 22. Edge restoration block receives contone image 
data 20 that may comprise an entire image or a portion of an image. At block 40 a target 
pixel from image data 20 along with the group of pixels neighboring or surrounding the 

10 target pixel are identified. Beneficially, this operation is performed using a 5x5 
observation window about the target pixel (xu) as illustrated in FIG. 4. 

After identifying the current target pixel x i3 and the surrounding pixels within the 
observation window, the target pixel and the surrounding pixels are passed through a 
series of three compaction modules, horizontal compaction module 42, vertical 

15 compaction module 44 and corner compaction module 46. Each of the compaction 
modules 42, 44 and 46 operates on the pixels within the observation window to compact 
one of three specific edge features. Horizontal compaction module 42 uses a vertical slice 
through the center of the observation window (x 3 , * 8 , *is, ^23) to compact horizontal 
features. Vertical compaction module 44 compacts vertical features using a horizontal 

20 slice through the center of the window (xn, *i 2 , *i5). Horizontal compaction 

module 42 together with vertical compaction module 44 will treat gray edge compaction 
for angled features. Corner compaction module 46 uses the entire window to compact 
corner features. 

The horizontal, vertical, and corner compaction modules each operate on the 
25 pixels within the observation window in substantially the same manner. Each compaction 
module analyzes the target pixel and the pixels neighboring the target pixel to determine 
whether the target pixel is within a diffuse gray edge. If the target pixel is within a diffuse 
gray edge, the module compacts the specific features associated with that module. When 
analyzing a target pixel and neighboring pixels to determine if the target pixel is within a 
30 diffuse gray edge, each compaction module looks for a specific diffuse edge condition. 
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Horizontal compaction looks for a diffuse horizontal edge defined by two gray pixels 
between the pixel pair x 3 and jci 8 or between the pixel pair x 8 and x 2 3 wherein one pixel in 
each pair is a saturated pixel and one pixel is a background pixel. Vertical compaction 
looks for a diffuse vertical edge defined by two gray pixels between a saturated pixel and a 
background pixel within pixels x i2 - x x5 or pixels jcn - x u . Corner compaction looks for a 
diffuse corner represented by four gray pixels bordered by five background pixels in the 
quadrant opposite to the saturated pixel. One such example of a diffuse corner is given by 
saturated pixel x 5 opposite gray pixels x 8 , *9, *n and jcu bordered by background pixels * 7 , 
xis and x\ 9 . 

The diffuse edge conditions described above (diffuse horizontal edge, diffuse 
vertical edge, and diffuse corner) can easily be represented by compaction patterns. 
Therefore, the analysis of target pixel and pixels neighboring the target pixel to determine 
if the target pixel is within a diffuse gray edge can be easily accomplished using pattern 
matching or template matching techniques as are known in the art of digital image 
processing. FIGS. 5 - 12 illustrate the compaction patterns needed to identify the three 
diffuse edge conditions. FIGS. 5 and 6 illustrate the two compaction patterns that identify 
a diffuse horizontal edge and, when present, trigger horizontal compaction. FIGS. 7 and 8 
illustrate the two compaction patterns that identify a diffuse vertical edge and trigger 
vertical compaction. The four compaction patterns needed to identify diffuse corners and 
trigger corner compaction are illustrated in FIGS. 9 - 12. In each of the FIGS. 5 - 12, 
double cross-hatched pixel represents a saturated or near-saturated pixel, an unfilled 
(white) pixel identifies a background pixel, and the cross-hatched pixels A, B, C and D 
indicate gray pixels. In the compaction patterns shown in FIGS. 5 - 8, pixel A identifies 
the gray pixel that is more distant to saturated pixel S, and pixel B identifies the gray pixel 
that is adjoining saturated pixel S. In each of the patterns of FIGS. 9 - 12, pixel B is a 
gray neighbor of saturated pixel S and pixels A, C, and D are connected to pixel B and in 
the quadrant opposite to the saturated pixel. 

As previously indicated, the determination that the target pixel is within a diffuse 
gray edge will result in a subsequent operation to compact a specific edge feature. Each 
of the compaction modules 42, 44 and 46 operates on the pixels within the observation 





window to compact a specific edge feature by shifting gray from a pixel that is more 
distant to a saturated pixel to a pixel that is adjoining the saturated pixel. Horizontal 
compaction module 42 shifts gray from pixel A to pixel B whenever the compaction 
patterns shown in FIGS. 5 and 6 are found. Similarly, vertical compaction module 44 

5 shifts gray from pixel A to pixel B when either of the compaction patterns shown in FIGS. 
7 and 8 is found. Both horizontal compaction module 42 and vertical compaction module 
44 use the same rules for shifting gray from pixel A to pixel B. Assuming the value of 
saturated pixel is 255, the rules used by modules 42 and 44 for shifting gray between 
pixels A and B are given by: 

10 Output pixel B' = min(255, B+A) (1) 

Output pixel A' = A-[min(255, B+A)] = A-B'+B (2) 
wherein A' and B' are the values of the pixels after shifting gray. 

Corner compaction module 46 shifts gray to pixel B from a combination of pixels 
A, C and D when any of the four compaction patterns of FIGS. 9 - 12 are found. 

15 Beneficially, module 46 first shifts gray from pixel A to pixel B using the rules given in 
equations (1) and (2). If the shift of gray from pixel A to pixel B does not saturate pixel B 
{i.e., B' < 255), gray is then shifted from one of the remaining pixels onto the modified 
pixel B (B') using equations similar to equations (1) and (2) but with a different donor and 
B being defined by the modified value. That is, shifting gray from pixel C onto the 

20 modified pixel B is given by following: 

Output pixel B" = min(255, B'+C) (3) 
Output pixel C = C-[min(255, B'+C)] = C-B"+B' (4) 
If pixel B is still not saturated (i.e., B" < 255), then a third shift of gray from the remaining 
pixel (here, pixel D) is performed as follows: 

25 Output pixel B'" = min(255, B"+D) (5) 

Output pixel D' = D-[min(255, B"+D)] = D-B"'+B" (6) 
It should be appreciated that other methods of shifting gray from pixels A, C and D to 
pixel B may be employed. For example, corner compaction can, as a second step, shift 
gray from the neighboring pixels C and D using linear combinations of pixels C and D. 
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Having briefly described the data flow of an embodiment of the present invention 
attention is now turned to FIG 13 which further illustrates an embodiment of the edge 
compaction method in accordance with the present invention. FIG. 13 is a schematic 
illustration of various steps in an edge compaction process in accordance with the present 
5 invention and an alternate representation of the data flow through an embodiment of edge 
restoration block 22 of FIG. 3. At block 50, an observation window comprising a target 
pixel along with a group of pixels neighboring the target pixel is identified. At test block 
52 the target pixel and a set of neighboring pixels are analyzed to determine if the target 
pixel is within a diffuse horizontal edge. Beneficially, block 52 uses pattern matching or 
10 template matching techniques to identify a diffuse horizontal edge. More specifically, 
block 52 analyzes the vertical slice through the center of the observation window (x 3 , x*, 
*i3, jcis, X23) using pattern or template matching techniques to determine if either of the 
1 compaction patterns shown in FIGS. 5 and 6 are present. 

* Alternative methods that are also within the scope of the present invention 

* 15 contemplate determining if the target pixel is within a diffuse horizontal edge by analyzing 
j gray pixels using techniques for identifying antialiased edges. Using antialiased tagging 

techniques analysis of the neighborhood of the target may be conducted, and if it borders a 
gray pixel on one side and occurs and at an abrupt transition between dark and light 
regions (e.g. the target pixel and the gray bordering pixel have a nearly saturated (black) 
20 pixel on one side and a background (white) pixel on the opposite side), then it is 
reasonable to assume that the target pixel is within a diffuse edge. Furthermore, 
techniques for identifying thin gray lines by counting transitions along cuts within the 
observation window may be adapted to a identify diffuse edges by requiring one transition 
to be between saturated and gray pixels and one transition to be between gray and 
25 background pixels. That is, the analysis of the target the target pixel and the pixels 
neighboring the target pixel may look for a transition from a saturated pixel to gray pixels 
and then a transition from gray to background along specific cuts within the observation 
window. 

More information on techniques for identifying and tagging antialiased pixels, and 
30 more specifically, techniques for identifying and tagging thin gray lines that can be adapted 




for the identification of diffuse gray edge can be found in the following co-pending, 
commonly assigned U.S. patent applications: "Method For Generating Rendering Tags 
To Facilitate The Printing Of Antialiased Images," P. Crean et al., Application No. 
09/046,232; "Tagging Of Antialiased Images," R. Loce et al., Application No. 
5 09/046,424; "Method To Enable The Recognition And Rendering Of Antialiased Images," 
R. Loce et al., Application No. 09/046,414; and "Memory-Efficient Tagging Of 
Antialiased Images," S. Harrington et al., Application No. 09/046,426, which are hereby 
incorporated by reference herein. 



10 to compact and the compaction process continues with test block 56, described below. 
An affirmative determination at block 52, will result in a subsequent operation, at block 54 
to shift gray from a pixel that is more distant to a saturated pixel to a pixel that is adjoining 
the saturated pixel in accordance with equations (1) and (2) above. After shifting gray 
between pixels in the diffuse edge, block 54 updates pixel values within the image data. In 

15 updating pixel values in the image data, block 54 may employ a "conventional window" 
approach wherein the block generates a single output pixel corresponding to the modified 
target pixel that is used to generate the edge restored image data. With this approach, the 
observation window always views unmodified, original image pixels. Alternatively, block 
54 may employ a "diffusion" approach wherein the block modifies the gray values of the 

20 pixels in the observation window effected by the shifting operation. With either approach, 
after updating pixel values the compaction process continues at test block 56. 

Test block 56 analyzes the target pixel and a set of neighboring pixels within the 
observation window to determine if the target pixel is within a diffuse vertical edge. More 
specifically, block 56 analyzes the horizontal slice through the center of the compaction 

25 window (xn, x X2 , jc u , *i4, x i5 ) to determine if either of the compaction patterns shown in 
FIGS. 7 and 8 are present. The presence of either compaction pattern triggers the 
processing of block 58 to shift gray between pixels in the diffuse edge in accordance with 
equations (1) and (2) and then update pixel values to generate edge restored image data. 
In updating pixel values, block 58 employs the same approach ("conventional window" or 

30 "diffusion") used by block 54. 



A negative determination at block 52 indicates that there are no horizontal features 
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Test block 60 performs an analysis on the pixels within the observation window to 
determine if the target pixel is within a diffuse corner after a negative determination at test 
block 56 or after the shifting and updating operations of block 58. Beneficially, test block 
60 uses pattern matching or template matching techniques to determine if any of the 
compaction patterns shown in FIGS. 9 - 12 are present. If any of the four compaction 
patterns shown in FIGS. 9 - 12 are found, block 62 shifts gray between pixels within the 
diffuse corner and updates pixel values using the same approach employed at blocks 54 
and 58. 

An example of a compaction process is characterized below for the purposes of 
illustration and not for the purpose of limiting the scope of the present invention. Suppose 
the observation window comprises the pixel values as shown: 
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wherein the 25 pixels can be identified x u x 2 , x 2 s and are positioned/oriented as shown 
in FIG. 4. As previously stated, the first step is determining if the target pixel xn is within 
a diffuse horizontal edge. By inspection of the pixel values, it can be seen that pixels x 8 , 
jc 13 , jcis and x 2 3 comprise a diffuse horizontal edge. The next step is then shifting gray 
between pixels and updating pixel values. Using equations (1) and (2) gray is shifted from 
pixel Jtu to jcis resulting in modified pixel values for pixels x i3 and x i8 of 189 and 255, 
respectively. Employing a diffusion approach, the pixel values are updated in the 
observation window resulting in an observation window comprising modified image data 
4*iven by the pixel values: 
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Using the modified image data, the next step identifies a diffuse vertical edge at pixels x l2 , 
xi3, xu and x i5 resulting a second shifting and updating operation. The shifting operation 
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shifts gray from pixel x i4 to pixel x 13 . Using equations (1) and (2) the modified pixel 
values for pixels x i3 and x i4 are 255 and 10, respectively. Updating the pixels yields an 
observation window given by: 
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The updated image data is passed to the next step which analyzes pixels within the 
window to determine if the target pixel is within a diffuse gray corner. As the target pixel 
is not within a gray corner, the compaction processing for this window is complete. 

An example of a corner compaction process is characterized below for the 
purposes of illustration and not for the purpose of limiting the scope of the present 
invention. Assuming an observation window comprises the pixel values as shown: 
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wherein a diffuse corner matching the compaction pattern of FIG. 10 is defined by 
saturated pixel jc 22 opposite gray pixels x i3j *i4, *is and x i9 bordered by background pixels 
x 8 , *io, *is and jc 20 . Using equations (1) and (2) gray is shifted from pixel A to pixel B 
(pixel X14 to jcis) resulting in modified pixel values for pixels x X4 and x X s of 0 and 186, 
respectively. As pixel xi 8 is not fully saturated, gray is shifted from pixel C (pixel x x9 ) 
according to equations (4) and (5) yielding pixel values for pixels *i 8 and x X9 of 239 and 0, 
respectively. To fully saturate pixel * 18 a third shift of gray from pixel D (here, pixel x i3 ) is 
performed resulting in pixel values for pixels x {3 and x iS of 13 and 255, respectively. 

Under a conventional window approach, the corner compaction process provides a 
single output pixel value of 13 corresponding to the modified target pixel x X3 that is used 
to generate the edge restored image data. Employing a diffusion approach, the pixel 
values are updated in the observation window resulting in an observation window 
comprising the pixel values: 
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It is apparent that there has been provided, in accordance with the present 
invention, an edge restoration method for compacting a diffuse gray edge that is two 
pixels wide to a gray edge that is one pixel wide to enable the printing of antialiased 
images and other image structures having gray edges. While this invention has been 
described in conjunction with preferred embodiments thereof, it is evident that many 
alternatives, modifications, and variations will be apparent to those skilled in the art. 
Accordingly, it is intended to embrace all such alternatives, modifications and variations 
that fall within the spirit and broad scope of the appended claims. 
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